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1 Introduction 

Regularity properties of collections of sets play an important role in several 
areas of variational analysis and optimization like coderivative-subdifferential 
calculus, constraint qualifications, stability of solutions, and convergence of 
numerical algorithms. 

Various regularity properties of collections of sets have proved to be useful: 
(bounded) linear regularity PH71 |281I33[ |36''37'. metric inequality |131I14[[51] . 
(strong) conical hull intersection property |2n5n6H8| f51lllll28| . Jameson's property 
(G) [51126] . We refer the readers to pilSlI^ for the relationships between these 
properties and the overview of the areas of their applications in analysis and 
optimization. 

The uniform regularity property introduced recently in |20j and further 
developed in PT1B5] is stronger than local linear regularity even in the convex 
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case. It corresponds to the metric regularity property of set-valued mappings 
and is closely related to the (extended) extremal principle. The most recent 
development is the application of this property in convergence analysis of 
projection algorithms by Lewis et al. [27], Attouch et al. [J, Luke {^[50] . and 
Hesse and Luke [T^]. 

Uniform regularity of a collection of sets in a normed linear space is char- 
acterized quantitatively in by certain nonnegative constants defined 
in terms of elements of the primal or dual spaces. In the setting of a finite 
dimensional Euclidean space, Lewis et al. f27| introduced another nonnega- 
tive constant characterizing the uniform regularity of a collection of two sets 
and used it when formulating convergence rates of averaged and alternating 
projections. 

In the current note, we consider a (not necessarily nonnegative) modifica- 
tion of the constant from |27| in the setting of an arbitrary Hilbert space and 
establish its relationship with the dual space constant from . The latter 

constant admits a simplified equivalent representation in Hilbert spaces. As 
an application, we employ these constants to establish convergence results of 
projection algorithms. 

The structure of the paper is as follows. In Sectionj^l we recall the uniform 
regularity property of a finite collection of sets in a normed linear space, its 
main characterizations and connections with some other properties. In Sec- 
tion [21 we consider the case of a collection of two sets in a Hilbert space 
and establish the relationship between the dual space constants from j20If25] 
and [37] . The final Section [J] is dedicated to the convergence estimates of pro- 
jection algorithms. 

Our basic notation is standard, cf. |31ll35j . For a normed linear space X, its 
topological dual is denoted X* while (•, •) denotes the bilinear form defining 
the pairing between the two spaces. The closed unit ball in a normed space is 
denoted B. Bs{x) stands for the closed ball with radius S and center x. 



2 Uniform regularity of a collection of sets 

In this section, we recall the uniform regularity property of a finite collection 
$1 := /22, ■ • ■ , ^m} (™ > 1) of sets in a normed linear space X near a 
given point x S H™ j^]?^. The property was introduced in |20j (under a different 
name) and further developed in |3TH25] . 

Definition 1 is uniformly regular at x if there exist numbers d,a > such 
that 

m 
i=l 

for any p € (0; (S], oj.; G 12^ n Bs{x) and £ {ap)M, i = 1, 2, . . . , m. 
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Uniform regularity of a collection of sets can be equivalcntly characterized 
in terms of certain nonnegative constants: 



Op[n]{x) :=sup<^ r > 



max 

l<i<n 



IWiW < r L pe (0;c3o] 



e[fl\{x) -.^ liminf 



6p[f2i - U!i, Qi-bJ2,---,^m- Wm](0) 



Here ^ x means that — > x with uji G fli. 

These constants characterize the mutual arrangement of sets fli (1 < i < 
m) in space and are convenient for defining their extremality, stationarity and 
regularity properties. 

The next proposition follows directly from the definitions. 

Proposition 1 Jl is uniformly regular at x if and only if 9[^l]{x) > 0. 

When constant 0[r2](i) is positive, it provides a quantitative characteriza- 
tion of the uniform regularity property. It coincides with the supremum of all 
a in the Definition [T] 

The case 6'[Jl](a;) = 0, i.e., the absence of the uniform regularity, corre- 
sponds to approximate stationarity [18H22| of at x, the latter property being 
a relaxation of the extremality property introduced and investigated in f25j . 
We refer the reader to [531 Section 3] for a modern summary of extremality, 
stationarity, and regularity conditions for finite collections of sets. 

Another nonnegative primal space constant (being a small modification of 
the corresponding one introduced in |20) ) can be used for characterizing the 
uniform regularity: 



max d{x + Xi, f2i) 

mm := liminf 

a;— >a;, a;^— >0 (l<i<m) 



i=l 



The next proposition corresponds to [20l Theorem 1]. 

Proposition 2 e[n]{x) = m]{x). 

As a consequence, Jl is uniformly regular at x if and only if 'd[Ct\{x) > 0. 

It was shown in pOH^ that the uniform regularity of a collection of sets 
can be interpreted as the direct analogue of the fundamental in variational 
analysis metric regularity property of multifunctions. 

Regularity properties can also be characterized in terms of elements of the 
dual space using appropriate concepts of normal elements. Given a subset ]7 
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of X, a point x in and a number (5 > 0, the sets (cf. [T51I5T| ) 



Nn{x) := I X* e X* \ limsup \ _7 < , 

iVr2(x,(5):= |J iVr2(a;), 

xes'2nBs{x) 

Nn{x) ■.= \imsnpNn{x) = f] d*Ns{x\n) 

x^x (5>0 

denote the Frechet normal cone, the strict S-normal cone, and the limiting 
normal cone to i7 at x, respectively. The denotation m ^ a; in the above 
formulas means that u x with u £ [2 while el* denotes the sequential weak* 
closure in X* . 

In the Asplund space setting, the uniform regularity of a collection of sets 
can be characterized using the next dual space constant: 



?7[r2](a;) :— liminf ■ 



(1) 



where it is assumed that the infimum over the empty set equals 1; this corre- 
sponds to all cones N[}^{x, 5) (1 < i < rn) being trivial for some 5 > Q {x can 
be an interior point of n™ 

The next theorem corresponds to [22l Theorem 4 (v)-(vi)]. 

Theorem 1 (i) 9[Vl\{x) < 

(ii) Suppose X is Asplund and the sets Qi (1 < * < Tn) are closed. Then 

m{x)^fm{x). 

As a consequence, f2 is uniformly regular at x if and only if f}[0\{x) > 0, 
i.e., there exist a > and 8 > Q such that 



(2) 



for all Xi G i7j n Bs{x) and x* € N^iixi) (I < i < m). 



The dual characterization of the uniform regularity in Theorem [T] (ii) is 
sometimes referred to as (Frechet) normal uniform regularity, cf. |22ll23j . Con- 
stant ^[r2](a;) coincides with the supremum of all a in the definition of this 
property. 

Part (i) of Theorem [T] was proved in [T^ , while part (ii) was established 
in [52]. A slightly weaker estimate can be found in [TOll?!] . 

Remark 1 In finite dimensions, constant ([T} coincides with the corresponding 
one defined in terms of limiting normals: 



77[r2](a;) := min ■ 



= 1 
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(with the similar natural convention about the minimum over the empty set). 
The dual uniform regularity criterion in Theorem [T] (ii) takes the following 
"exact" ("at the point") form: 

there exists a > such that ([2]) holds true for all x* G Nq. (x) (1 < i < m), 
or equivalently, 



This is a well known qualification condition, cf. |31l Corollary 3.37]. 

Apart from the formulated in Theorem [1] (ii) necessary and sufficient char- 
acterization of the uniform regularity, equality 0[11](5;) = 77[Jl](.f) implies also 
an equivalent characterization of approximate stationarity. 

Corollary 1 (Extended extremal principle |18Lll9p Suppose X is As- 
plund and the sets fii {I < i < m) are closed, is approximately stationary 
at X if and only if 'fj[n]{x) ~ 0, i.e., for any £ > there exist Xi € fiiO Bg{x) 
and X* €z Nf2i{xi) (1 < i < m) such that 



This result extends the extremal principle [25ll32j and can be considered as 
a generalization of the convex separation theorem to collections of nonconvex 
sets. Some earlier formulations of Corollary [T] can be found in [15lll7) . 

Remark 2 Corollary [T] provides also an equivalent characterization of Asplund 
spaces, cf. [521 Theorem 5]. Theorem [T] (ii) can be extended from Asplund to 
arbitrary Banach spaces if Frechet normal cones are replaced by some other 
kind of normal cones satisfying certain natural properties, e.g., Clarke normal 
cones, cf. [231 ■ 

Remark 3 Theorem[T]can be extended to infinite collections of sets. This allows 
to treat infinite and semi- infinite optimization problems, cf. |23ll24j . 

Verifying the uniform regularity (and several other properties) of a finite 
collection of sets can always be reduced to that of two sets in the product 
space. 

Proposition 3 ( :2() . Proposition 4) ft is uniformly regular at x if and 
only if the collection of two sets 

J7 := i7i X i72 X . . . X i7„i and L := {{x,x, . . . ,x) \ x <E X} (3) 

in A"™ ( with any norm compatible with that in X) is uniformly regular at the 
point (x,x, . . . ,x). 




m 



Y^x* <e^||x*||. 



1 = 1 4=1 
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Note the following simple representations of the Frechet normal cones to 
the sets in 

Proposition 4 (i) Suppose Xi € Qi (1 < i < m). Then 

m 
i=l 

where z = {x\,X2-, ■ ■ • , im)- 
(ii) Suppose x G X. Then 

nl{z) = = |z* = (xj , . . . , <) e {x*r I E ^: = o| , 

where z = Ax :— (x^x, . . . ,x). 

Proof The first assertion follows directly from the definition while proving the 
second one is a simple exercise on application of standard tools of convex 
analysis. □ 



3 Uniform regularity in a Hilbert space 



In this section, we limit ourselves to the case when X is a Hilbert space. For 
the collection of sets = {fii, ^2, ■ ■ ■ , f2m} {fn > 1), denote 



mm :=l-2(r}[n](x))2, 



(4) 



where ?7[Jl](a;) is the dual space regularity constant defined by ([T]). By The- 
orem [T] (ii), the uniform regularity of at a; is equivalent to the inequality 
c[S},]{x) < 1. Note that constant Q can be negative: c[r2](a;) > —1. 

Lemma 1 Suppose H is uniformly regular at x. Then, for any c' > c[n]{x), 
there is 6 > such that, for any i,j G {l,2,...,m}, i ^ j, and any u e 
{x, J) n S, w G Nn, {x, 5) n S, it holds: 

- {u,v) < c'. (5) 

Proof By definition ([T]), for any c' > c[r2](x)), there is 5 > such that 

2 



k=l 



> 1 - c' for aU xl e Nn^ (x, S) with \\xl 

fc=i 



1. 



Choose any i,j e {l,2,...,m}, i ^ j, and any u S Ni-2.{x,S) n §, w € 
Nf2^{x,S)nS. Set X* = u/2, x* = v/2, and xl = for k e {1,2, . . . ,m}\{ij}. 
Then xl £ Nn^{x,S) {k e {l,2,...,m}) and ^"^^ \\xl\\ = 1. It follows that 



7i + uj 



m 

E 

A;=l 



>2(l-c'), 
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or equivalently 

2 + 2{u,v) > 2(1 - c'). 
In its turn, the last inequality is equivalent to ([S]). □ 

In the rest of the section, we assume that m — 2, i.e., Jl — {fii, fii]- Defi- 
nition ([l} of the constant characterizing the uniform regularity of a collection 
of sets can be simplified. 

Proposition 5 The following representation holds true: 



7}[rj](x)=hminf|||a;J+.. 



x1,\\\xteNaA^,6)A\x*\\ = \{i = l,2)\, (6) 



where it is assumed that the infimum over the empty set equals 1. 

Proof If, for some 6 > Q, one of the cones Nq^{xt5) or Nq^{x,5) is trivial, 
then ^[f2](a;) = 1 and the equality is satisfied automatically. Take arbitrary 



nonzero xl G NnA^,5) and e Nq^{x,5) such that + || 

(ll^^ll-lk;il)' = ll^tlP + lk2lP-2||xi||||x;||, 
i = lklf + lkSlP + 2||xt||||.T*||. 



1. Then 



Hence, 



1 



a;, - \\Xo 



\\<\\\\^*2\\ 



1- (11^111-11^211)' 



Set 



Then z* € 7Vf2i(x,(5), £ Nn2{x,S), 



and 



^2 



2\\x* 



1 



~ 11^211 - 2 



= i and 



2 2||a;t 



Next we show that 
Indeed, 

+X*2f - i|Zi* +Z2i 

1 + nixT 



\xl+X*2\\ > M 



" ^" " ^" ^ \ 1' 2/ 2 2 xS 



iixsin^ 1 



(xT.xS^ 
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This completes the proof. □ 

The foUowing example shows that the conclusion of Proposition [5] is not 
true in non-Hilbert spaces. 

Example 1 Consider with the sum norm, ||(a;,y)|| ~ \x\ + \y\, and take 
Qi = {{xi,X2) I X2 < 0}, {2-2 = {{xi,X2) I X2 > 2xi} and x = (0,0) G /?ini72. 
Then, for any 6 > 0, we have 

NnA^,S) = {t{0,l)\teR+}, 
NnA^,6)^{t{2,^l)\tem+}. 

Thus, 

zl £ Nn,{x,S) with ||z*|| = l=^zl = (0, i), 

z*2 G NnAx,S) with ||z*j| = 1 ^ z* = (1/3, -1/6), 

and the right-hand side of © equals \\zl + 411 = 11(1/3, 1/3)|| = 2/3. At the 
same time, with x* = (0,1/4) G 7Vr2^(x,(5) and = (^,-1/4) G A^r^al^,^) it 
holds 11x^11 + = 1 and +a;^|| = i. Hence, fi[n]{x) < \\xl+x*2\\ < 2/3. 

A 

The next proposition provides an equivalent representation of constant ([¥]). 
Proposition 6 The following representation holds true: 

c[n]ix) = limsupf-(.Tt,x*) I X* G Nn,ix,S), \\x*\\ = 1 (i = 1,2)} . (7) 

where it is assumed that the supremum over the empty set equals —1. 

Proof If, for some S > 0, one of the cones Nq^ {x, 6) or Nq^ {x, 5) is trivial, then 
r)[Jl](a;) — 1, the right-hand side of ([7]) equals —1 and coincides with c[r2](i) 
computed in accordance with definition Let both cones be nontrivial for 
any S > 0. Then, by (g]), ©, and ©, 

cmx) = Hmsup l^l-2\\xl+x;f \x* e NnA^,S), \\x*\\ = i (z = 1,2)| 

= Inn sup l^-{2xl2x*2) \ x* G iV,,.(x, 5), \\x*\\ = i (* = 1, 2) 

= cm{x). 

□ 

Another dual space constant can be used alongside ([5]) and (O for charac- 
terizing the uniform regularity of a collection of two sets in a Hilbert space: 

:=limsup|||a;I -x^ll | x* e ^r2.(x,<5), ||x*|| = i (* = 1,2)| , (8) 

where it is assumed that the supremum over the empty set equals 0; this 
corresponds to one of the cones Nq-^{x, 5) or Nq^(x, 6) being trivial for some 
5 > {x can be an interior point of either f2i or f22)- 
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Remark 4 Unlike constants and c[r2](a;), the definition of constant 

/>[$!] (x) is specific for tlie case of two sets. 

Remark 5 Condition = i, i = 1,2, in definition ([8]) cannot be replaced 
by \\xl\\ + IIxjII = 1 (as in ([T])): it would always be equal to 1. 

Theorem 2 The following relations hold true: 

ft) imm' + imm'-i; 

(it) l + c[n]{x) = 2(z>[0](.t))2. 

Proof If, for some 6 > 0, one of the cones Nnj^{x,5) or N^^^XjS) is trivial, 
then ri[S},]{x) = 1, 0[n]{x) = 0, c[r2](a;) = — 1, and equalities (i) and (ii) are 
satisfied automatically. Let both cones be nontrivial for any S > 0. Fix an 
arbitrary e > 0. 

(i) By definition ([8]), there exists 6 > such that 

\\xi - x;\\ < iy[n]{x) + e 

for any x* € Nn-{x,S) with |jx*|| = | (i = 1,2). At the same time, by ([6]), 
there are elements x* € Nq.{x, 5) with = i (i = 1, 2) such that 

\\xl+xl\\<ff[U\{x)+e. 

Hence, 

{mm + ef + imi^) + ef > n^^ - ^^n^ + w^i +xif^i. 

Since e is arbitrary, we have 

77[f2](xf + > 1. 

Similarly, by (O and (|5|), we find elements x* e Nq^^.S) with ||a;.*|| = i 
(i = 1, 2) such that 

\\xl-xl\\>m]{x)~e, 
\\xl+xl\\ >f,[n]{x)-e. 

This yields 

and consequently, 

f,[n]{xf + v[n\{xf < 1. 

(ii) follows immediately from (i) and definition (|3]). □ 

Corollary 2 {i7i, i72} is uniformly regular at xCz fii H f22 if o,nd only if one 
of the following equivalent conditions holds true: 

(i) r)[f2](x) >0,- 
(ii) v\n\{x) < 1; 
(Hi) c[fl]{x) < 1. 
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The next example shows that the equahty in Theorem [5] (ii) remains true 
when c[n]{x) < 0. 

Example 2 In with the Euchdean norm, we fix Hi = {{xi,X2) | a;2 ^ 0} 
and X = (0, 0). Then, for any 6 > 0, N^^ {x, S) = {t{0, 1) \ t > 0}. We consider 
the following two cases of ^2'- 

Case 1. [22 = {(xi,X2) | xi < 0}. For any S > 0, Nn^{x,5) ^ {t(l,0) | t > 
0}. Then c[n]{x) = and i)[fl]{x) ^. 

Case 2. Q2 = {(2:1, 2:2) | a;i +a;2 < 0}. For any (5 > 0, Nn^{x,5) = {t{l, 1) | 
t > 0}. Then c[n]{x) = and i)[n]{x) = 

In both cases the equality in Theorem [2] (ii) holds true. A 

Remark 6 In finite dimensions, constants (IHl)^© coincide with the correspond- 
ing ones defined in terms of limiting normals: 



nm{x) 


:= min | 


\\xl+x1,\\ 


\x*eNnMAK\\ 




= 1,2)} 




mm 


:= max < 


> \\Xi ~ X2I 


|< eiVr2,(i),||<| 




= 1,2) 


[, (9) 




:=max{-(.Ti,X2) 


l< G^r2,(x),||.<|| 


= l(z = 


= 1,2)} 


(10) 



(with the similar natural conventions about the minimum and maximum over 
the empty set). The relations between the above constants are consequences 
of those in Theorem [5] 

(i) (^[fl](x))2 + (p[n](x))2 = l; 

(ii) i + mi.^)^m'^m?\ 

(iii) i--cmi)^mm{i)?- 

Remark 7 Constant ([TU)) is closely related with the one introduced in |27) : 

c := max{-(x*,a;2) | x* e 'Nn^{x)r\M {i = 1,2)} . 

Indeed, c= (c[f2](a;))+, where (a)+ max{Q;,0}. 

Given a collection of m sets fl = {f2i, ^2, ■ ■ ■ , fim } in a finite dimensional 
Hilbcrt space X and a point x € O^Li^i^ one can consider the Hilbert space 
with the norm 

Cm \ 2 

and compute constants ([5]), (O, and ([5]) corresponding to the collection il' := 
{i7, L} and the point z := Ax = (x, x, . . . , x) € H L, where I? and L are 
defined by ©. 
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Proposition 7 The following representations hold true: 



4 



= Hminf I ( 1 - 1 ( 1 - 1 IL^t + . . . + X* 



2 2 V m 

X* € Nn,ix,S) (1 < z < m),^ IKIP = 1 I (11) 



i=l 



i\ 2 

2 ' 



X* e ^r2.(S,<5) (1 < * < ™),^ IKIP = 1 , (12) 



c[r2'](z) = limsup 

(5^0 V 



1 

_ II 



x* + ...+x*f 



X* e 7V,,^(x,<5) (1 < z < m), = 1 . (13) 

1=1 J 

Proo/ If zi = {xi,X2, ■ ■ . ,a;„), Z2 = (mi,'"2, . . . , tt„) £ X™, then 

m m m 

\\Z1 + Z2f = \\^^\\^ + + 25I(2^.:«.)- 

i— 1 i— 1 i— 1 

By the structure of 11' and (O, we have 

{/ ^ m \ 2 m m ^ 

i-+2Y{^iu,)\ \Y\\^*r =j2\\'Hr = ^, 

in \ 

e iVf2,(x,(5),^u, = (1 < i < m) i 



lim inf < 
64,0 1 



i=\ 

\ 

\ 2 m 



■1=1 / 1=1 1=1 



X* e iV,2.(a;,<5),^u, = (1 < i < m) \. (14) 

i=l J 

Fix any x* S iVf2i(x,(5) (1 < i < to) with X]"=i ll^^ilP = 1 ^'^'^ denote 

rn 

-E<- (15) 



TO 

■i=l 
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Consider the following minimization problem in X™ which is an important 
component of (jl4p : 



minimize /(w) :— y~^(a;*, u.^/ 

m m 

subject to Ui = and = 1. 

1=1 1=1 

Since / is continuous and the constraint set is compact, the above problem has 
a solution u° ~ (uJ,U2, . . . In accordance with the Lagrange multiplier 

rule, there exist multiplies Ao, Ai G K and u* € X, not all zero, such that 

Aoa;,* + 2Ai< + u* ^ {l<i<m). (16) 

Adding the equalities together and taking into account that X]i=i ''^i ~ 0, we 
obtain 

rn 

Ao X* + mu* = 0. (17) 
i=i 

If Aq = 0; then u* = and consequently \i ^ Q and, by (|T6)) . w° = for 
all i £ {l,2,...,m}, which is impossible thanks to X]i=i ll^i'P = 1- Hence, 
Ao 7^ and we can take Ao = 1. It follows from p^ . p7|) . and p3|) that 

a;*+2Ai<:=x* (1 < i < m), (18) 

and consequently 



m 

J2\\x*r-rn\\x*r. (19) 



i=l 

At the same time, 



2Ai/(h°) = 2Ai<) = - 

/ / m \ m \ 



1=1 I i=l 



This yields either f{u°) = — 2Ai or Ai = 0. In the last case, by pS)) . x* 
for alH G {1,2,..., to}, and consequently 

?7i / in \ 

/(«°)=^(a;5,<) = (.TS,5]<)=0. 
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Hence, in both cases, f(u°) — — 2Ai. Since u° is a point of minimum, Ai must 
be nonncgativc. and consequently, by (jl9p . 



Combining this with (fT4)) . we get ((TT|) . 

and (Hn]) follow from ((ni) thanks to Theorem [H □ 

Corollary 3 The following estimates hold true: 

1 

./l^<c[fl'](z)<l. 
V m 

Proof The estimates follow from Proposition [7] due to the fact that 

min{!|a;i+a;2 + ... + a:,„j| | \\xif + \\x2\\^ + ... + \\x,n\\^ = 1} < 1- □ 

Dual space constants ([TT|) . (fT^ . and (fT5)) can be used to characterize the 
uniform regularity of collections of m sets. 

The next corollary follows from Proposition |3] and Corollary [2] 

Corollary 4 J7 is uniformly regular at x € f2i if and only if one of the 
following equivalent conditions holds true: 

(i) f,[n']{z) > 0; 
(a) v[^']{z) < I; 
(Hi) c[n']{z) < 1. 

Observe that, when m ~ 2, constants (ITT]) . (|12p . and (fT5|) do not coincide 
with the corresponding constants ([5]), ([5]), and ([7]) . 




^-m\\x*J\^ 
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Corollary 5 When m ~ 2, the following relations hold true: 

77[fl'](z) = lirninf|(^i— | x* E N.^^S) {^ ^ 1,2), 



1 



1-1 ^ -^21 



x*€Nn^ix,d) {i = l,2), 
1 1 



„* l|2 



Proof From Proposition [7j we have 



x*€NnAx,d) {t^l,2). 



(20) 



c[n']{z) = ]imsnp{ 1- -11x1+ a;* II' | x* e Nn^xJ) (* = 1,2) 



1/2 



Ik^ll =1 



111 the above formula, 

^-l\K + ^*2f = li2-\\xi + x;f) 



1 



(2(||x^|p + llx^lp) - (||x*|p + ||^;f + 2K, z^))) 
(ll^lf + ||x*|p-2K,x*)) 



_ X 1 Xn 



and 



a^i 


2 


2^2 


V2 


+ 


x/2 



Xi X2 

V2 V2 



This proves ([20]) . which also implies the other relations. □ 

The next relation between c[r2'](2) and t'[J7](a;) can be of interest. 
Proposition 8 When m = 2, it holds: 

c[n']{z) > i)[n]{x). (21) 

Furthermore, (j2ip /loZds as an equality whenever !>[r2](i) > l/\/2- 
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Proof In view of ([20]) and ([S]), inequality (PT|) is always true. 

We prove the second assertion. Suppose i>[f2](x) > 1/a/2- By ([5]), for any 
6 > 0, one can find X* e Nn^{x,S) with ||a;*|| = i (i = 1,2) such that 
\\xt-x*2\\ >1/V2. 

Observe that, for any xl and X2 with ||a;i|l^ + |1.T2|1^ = ^, it holds 

\\xl-x*f = l-2{xl,x;). 

Hence, maximizing \\xl — X2II is equivalent to minimizing (a;J,a;2), and condi- 
tion II X* — Xgll > l/-\/2 is equivalent to (xJjXj) < 0. Under the assumptions 
made, 

sup { \\xl -x;\\\ X* G Nad^,S) (i = 1,2), \\xlf + Mf = 
= sup{ ||.Tt - x^ll I X* e Nnd^,S) (i = 1,2), \\xlf + Mf = (.t^x^) < o} 
= sup{ ||.Tt - x^ll I X* G Na,{x,S), \\x*\\ = ^ (* = 1,2), (xlx^) < o}, 
and it follows from ^ that c[fl']{z) = C'[ft]{x). □ 



4 Applications in projection algorithms 

Inspired by |27] . we are making an attempt to extend convergence results 
of the alternating projections for solving feasibility problems to those of the 
cyclic projection algorithms in Hilbcrt spaces. Recall that a feasibility prob- 
lem consists in finding common points of a collection of sets with nonempty 
intersection. This model incorporates many important optimization problems. 

We first recall some basic facts about projections. Given a nonempty set 
[2 in a normed linear space X , the distance function and projection mapping 
are defined, for x G X, respectively, as follows: 

d(x, I?) := inf ||x — io\\ , 

Pn{x) := {w e 12 I ||x - a;|| = d(x, Q)} . 

Lemma 2 ( [TO]) lj € Pn{x) x - w e Nq{uj). 

From now on, we are considering a finite collection of closed sets $1 = 
{]?!, f22i • • ■ , ■!^m} [m > 1) and assuming the existence of a point x S ^•'^j- 

Definition 2 A sequence (xfc) is generated by 
(i) the averaged projections for if 

e - VPr2.(xfc), fc = 0,l,...; (22) 
m — ' 

1=1 
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(ii) the cyclic projections for if 

Xk+i e Pok+ii^k), fc = 0, 1,..., (23) 
with the convention J7i-|_„m = i?; for ah i = 1, . . . , to and n e N. 

Note that the existence of the sequences in Definition [5] cannot be guaran- 
teed in general, unless the space is finite dimensional. 

From now on, we are assuming that X is a Hilbert space. The next regu- 
larity property is needed in our analysis. 

Definition 3 ( |27] . Definition 4.3) A closed set is super-regular at 
a; G i7 if, for any 7 > 0, any two points x, z sufficiently close to x with z g 
and any point y G Pa{x), it holds (z — y,x — y) < ^\\z — y\\ ■ \\x — y\\. 

Lemma 3 ( [27j . Proposition 4.4) A closed set Q is super-regular at x G il 
if and only if for any 7 > 0, there is 6 > such that 

(u, z — x) < j\\u\\ ■ j|z — Vz, x G ]7 n Bs{x), u € Nn{x). 

Theorem 3 Suppose Jl is uniformly regular at x with 

mi^) < (24) 

TO — 1 

and fii is super-regular at x. Then, for any c G ((to — f )c[r2](5;), f ), a sequence 
(xk) generated by cyclic projections for ft linearly converges to some point in 
n™ with rate '-^/c, provided that for each k ~ 0,1, . . . , 

\\xkm+i+l - Xkm+i\\ < \\Xmk+2 - Xkm+l\\ (i = 2, . . . , to) (25) 

and xq is sufficiently close to x. 

Proof Let c G ((m - f )c[f2](x), 1). Choose c' > c[r2](i) and 7 > such that 
(to — l)c' + m7 < c and S > such that the conclusions of Lemmas [T] and [3] 
(with n = S7i) are satisfied. 
Let Xq & X he such that 

II -II '5(1 -c) 



2(to-|- f)' 
Then 

a := ||.Ti - x\\ < \\xi - xoW + \\xa - x\\ < 2\\xa - x\\ < — — ^ (26) 



and, by (^5]) . 

||.Tj - < \\xi - a;,_i|| + . . . + ||a;i - x\\ 



< (i - i)\\x2 — xi\\ + \\xi — x\\ < i\\xi — x\\ 

=^ia<{m + l)a (z = 2, . . . , m + f ). (27) 
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Wc arc going to prove by induction that, for all /c = 0, 1, . . ., 

1 - 0*^+1 

\\xkm+i-x\\<{m + l)a— (i = 2,...,m + l). (28) 

1 — c 

When fc = 0, the required inequalities have been established in (P7|) . Supposing 
that the inequalities are true for all fc = 0, . . . , Z where / > 0, we show that 
they hold true for fc = Z + 1. 
We first prove that 

l|a;(fc+i)m+i - a;(fc+i)m|| < c||a;fe„i+2 - a-fcrn+ill (fc = 0,...,/). (29) 

Indeed, lixi^k^iy^+i — X(^k+i)m, the inequality is trivially satisfied, li Xkm+2 — 
Xkm+i, then, by condition ((251), X(^k+i)rn+i = X(^k+i)Tn, and the inequality is 
satisfied too. Otherwise, by ((26)) and ((28|) . \\xkm+i — x\\ < 5 (i = 2, . . . , m + 1) 
and we have by Lemmas [1] and [21 condition (|25p and definition of projections: 

{X{k+l)m ~ X(^k+l)m+lj Xkm+i+1 — Xkm+i) 

< c'\\Xi^k^i^„i — X(^k+l)m+l\\ ■ \\xkm+i+l — Xkm+i\\ 

< c'\\X(^k+l}m ~ X(^k+l)ni+l\\ ■ \\xkm+2 - Xkm+l\\ (l = 1, . . . , m - 1). 

Adding the above inequalities, we obtain 

{X{k+l)m ~ 2^(fc+l)m + l7 2^(fc+l)m ~ Xkm+l) 

< (m - l)c'||a;(fc+i),„ - X(^k+l)ni+l\\ ■ \\xkm+2 - Xkm+l\\- (30) 

At the same time, by Lemma [31 the triangle inequality and condition (|25p . 

{X{k+l)m ~ X(^k+l}m+l, Xkm+l — X(k+\)m+\) 

< 7lk(fc+l)m - 2^(fc+l)m+l II • lk(fc+l)m+l " Xkm+\ || , 
m 

||.T(fe+i)„j+i - Xkm+A < X! ll-'^fcn' + '+l ^ ajfcm+ill < m\xkm+2 ^ Xkm+\\\, 
i=l 

and consequently, 

{^{k+l)m ^ ^{k+\)m.+li^km.+ \ ~ X(^k+l)m+l) 

< mj\\x(^k+l)m - 2;(fe+l)7n+l|| • ||a;A;m+2 ~ Xkm+l\\- (31) 

Adding ^ and we get 

||2;(A;+l)m — X (^k+l)m+l\\'^ < c\\x(^k+l)m " a;(fe+l),„+l || • \\Xkm+2 — a^fcrn+llj, 

or cquivalcntly 

l|2;(fc+l)m+l - X(k+l)m\\ < c\\xkm+2 - ^fcm+lH- 

This proves dHj). 
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Now with k = l + l and taking into account (P^]) . we have ioi i — 2, . . . ,m + 

1: 

||x(i+i),„+i - x\\ < \\x(^i+i)„i+i - a^(i+i)m+t-ill + . . . + ||a;(;+i),„ - x\\ 

< *ll^(i+l)m+l — + \\^{l + l)m, — ^1 

< ic'^^\\x2 - Xi\\ + \\xhn+„i - x\\ 

1 - c'+^ 1 - c'+^ 

< (to + l)ac'+^ + (to + l)a = (to, + l)a— — . 

1 — c 1 — c 

Finally we prove that (a;„) converges to some point x in H™ j/?,; with rate 
y/c. Take any fc, r S N with fc > r and choose n E N and i e {0, 1, . . . , 7ti — 1} 
such that r = tito + i. Wc have 

fc— 1 oo 



\\Xk - Xr\\ < \\Xj + i - XjW < \\Xj + i - Xj\ 



3=r 

oo m — 1 



< ^ ^ \\Xmj+t+l - X„ij+i\\ < TO^ \\x„ij + i - X„ij\ 
j—n i—0 j—n 



,, v-^ mac 

<TO xz-xi Vc^ < . 32 

■^-^ 1 — c 



Hence, x^H — > as fc, r — >■ oo, and consequently (x„) is a Cauchy sequence 
and, therefore, converges to some point x E X. It follows from ([5^ that 

mad^ ma r_ ma 

Finally, we check that x £ H™ j^/?^. Indeed, for any i E {1, 2, . . . , to}, x„„i+i € 
fli. At the same time, Xnm+i — ^ i as n — > oo, and consequently, by the 
closedness oi f2i, x £ Sli. □ 

Remark 8 When to = 2, conditions and ([Ml) are satisfied automatically. 
In the general case of to sets, condition (^5)) can be ensured by, e.g., the next 
monotonicity condition: 

||a;fc+2 -Xk+i\\ < \\xk+i -Xk\\ (fc = 1,2,...,). 

The convergence result of the alternating projection method, i.e., the cyclic 
projection method ((23)) when to = 2, established in [27J Theorem 5.16] is a 
consequence of Theorem [31 

Corollary 6 Suppose that fl is uniformly regular at x E f2i D fi2 md Qi is 
super-regular at this point. Then, any sequence generated by the alternating 
projections for Jl linearly converges to some point in the intersection provided 
that xq is sufficiently close to x. 
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Now, we derive from Corollary[n]another convergence result of the averaged 
projection algorithm for a collection of m sets. Given a collection of sets ft = 
{f2i, i72, • ■ ■ , ^m} in X, wc consider the collection ft' := {il, L} of two sets in 
X"' given by For x £ X, denote Ax := {x,x, . . . ,x) G L. 

Lemma 4 (i) For any x £ X , 

Pn{.Ax) = {Pn, [x), Pn, (x), . . . , Pn^ {x)) . 
(a) For any {xi,X2, ■ ■ ■ ,Xm) & X"^ , 

' Xi + X2 



Pl{Xi,X2, ■ . .,Xm) = A 

Proof The first assertion is straightforward (cf. [TOl Exercise 1.8]). To prove 
the second one, we consider the real-valued function / : X — > M defined by 



fix) :=^||x-a;,|| 



2 



It is obvious that Ax € Pl{xi, xit ■ ■ ■, Xm) if and only if a; is a minimizer of /. 
The conclusion follows from the first order optimality condition. □ 

Corollary 7 ( |27] . Theorem 7.3) Suppose that ft is uniformly regular at 
X G n"l]^J?i. Then any sequence (jjk) generated by algorithm i22\) linearly con- 
verges to some point in r]"^i f2i provided that the initial point yo is sufficiently 
close to X. 

Proof Let (zn) be the sequence generated by the alternating projections for 
the two sets f2 and L with the initial point zi := Ayi. By Lemma [4l Z2k = 
Ayk, k ~ 1,2, . . ., for some sequence (y„) C X. At the same time, {i7,L} is 
uniformly regular at Ax by Proposition [31 Therefore, when yo is sufficiently 
close to X, Corollary [HI implies that the sequence (z„) linearly converges to 
some point Ax G f2i O f22- It follows that the subsequence {z2k — Ay^) also 
linearly converges to Ax. Hence, (yt) linearly converges to x € n™ j^]?^. □ 
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